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1 Introduction 



Additional particle generations have been discarded for a long time. Recently this possibility 
(see [1] for a review) gained more interest. In contrast to many previous claims a fourth family 
is not in conflict with electroweak precision tests [2j, see also [31 U |5] for earlier works. The 
authors of [2j have shown that if the quark masses of the 4th generation fulfill the following 
relation 

m^/ -mt^ ^ (^1 + ^ In Yjf^^) ^ ^^'^^ 

the electro-weak oblique parameters [6j are within the experimentally allowed regions. This 
also has the crucial side effect that a fourth generation softens the current Higgs bounds, see 
e.g. 0. Moreover, an additional family might solve problems related to baryogenesis. First, 
it could lead to a sizeable increase of the measure of CP- violation, see [8j. Second it also 
would increase the strength of the phase transition, see [9j. In addition, the gauge couplings 
can be unified without invoking SUSY [10]. A new family also might cure certain problems 
in fiavor physics, see e.g. [lU [121 [131 [H] for some recent work and e.g. [151 [ISj foi" some early 
work on 4th generation effects on fiavor physics. 

In view of the (re) start of the LHC, it is important not to exclude any possibility for new 
physics scenarios simply due to prejudices. 

In this work we, therefore, perform an exploratory study of the allowed parameter range for 
the CKM-like mixing of hypothetical quarks of a fourth generation. In Section 2 we first 
describe the general parameterization used for the four generation CKM matrix, next we 
explain the experimental constraints for the quark mixing. We then describe the numerical 
scan through the parameter space and finally we present the allowed parameter ranges for 
the mixing with an additional family. In Section 3 we perform a Taylor expansion of the 
4x4 CKM matrix a la Wolfenstein, which makes the complicated general parameterization 
of VcKMA much clearer; in particular the possible hierarchy of the mixing is clearly visible. 
In Section 4 we discuss some peculiar parameter ranges, which show huge deviations from 
current knowledge of the threedimensional CKM matrix, and explain why these effects are 
not seen in the current CKM fits. Finally we conclude with an outlook on possible extensions 
of this exploratory study. 



2 Constraints on Vckm4. 
2.1 Parameterization of Vckma 

Let the minimal standard model with three generations of fermions be denoted by SM3. 
The mixing between quarks is described by the unitary 3 dimensional CKM-matrix pTl ITS] , 
which can be parameterized by three angles, ^12, ^13 and 623 {Oij describes the strength of 
the mixing between the ith and jth family) and the CP- violating phase S13. The so-called 
standard parameterization of Vckms reads 

C12C13 S12C13 sise-'^^^ 

Vckms = \ -S12C23- ci2S23Si3e'^'^ C12C23 - sisSss^ise'^'' S23C13 \ (2.1) 

with 



512^23 - Ci2C235i3e'^'' -C12S23 " 5i2C235i3e'^i3 ^^3013 



Sij := sin(^^j) and Cij := cos(%) . (2.2) 
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Extending the minimal standard model to include a fourth family of fermions (SM4) intro- 
duces at least 14 new parameters. We do not take into account any correlations to the mixing 
matrix of the leptons. The seven parameters that are directly related to the quark sector 

• 3 additional angles in the CKM-matrix, which we denote by ^14, 6^24 and ^34, 

• 2 additional CP- violating phases in the CKM-matrix: Su and ^245 

• 2 quark masses of the 4th family: m^/ and m^/. 

For the quark masses we have bounds from direct searches at TeVatron [T9l [20] 

m^/ > 268 GeV, m^/ > 256 GeV. (2.3) 

In [21] it was claimed that in deriving these bounds implicit assumptions about the couplings 
of the fourth family have been made. Without these assumptions the mass bounds can be 
weaker. We investigate the following mass parameter range - taking into account the results 
of 



300 GeV < nit: < 650 GeV , 

nib' = ''TT-t' — 55 GeV . 



(2.4) 
(2.5) 



245 GeV < my < 595 GeV . 



(2.6) 



Our goal is the determination of the current experimentally allowed ranges for the parameters 
6^14, 6^24, 6^34, ^^14 and 624- For our numerical analysis we use an exact parameterization of 
the four-dimensional CKM matrix. The form suggested by Fritzsch and Plankl [220 and 
simultaneously by Harari and Leurer [23] turns out to be especially useful, because in the 
limiting case of vanishing mixing with the fourth family the standard parameterization of 
the 3x3 CKM matrix is restored. Moreover, this form of the matrix reveals a particularly 
convenient structure: the simplicity of the first row is advantageous because these elements 
are experimentally very well constrained, while the compact form of the last column simplifies 
the Taylor expansion presented in Section 3. 



(4) 



CKM 



C12C13C14 



-C23C24S12 

-Cl2Ci3Si4S24e 



Cl2C24Sl3S23e' 
i(5i4 — ^24) 



C13C14512 



C12C23C24 - C245l2Sl3S23e'" 
-ClsSi2Si4S24e'^^''-^''^ 



-i6i3 



-Cl2C23C345i3e 



C34S12S23 



i6i 



-Cl2Ci3C24Sl4S34e 
+C235l2S24S34e'^'^ 
+Ci2Si3523524S34e'^^^^+^^^^ 

-Cl2Ci3C24C345l4e'^'^ 
+Ci2C23Si3S34e*^'^ 
+C23C34Sl2S24e'^'^ - Sl2523534 
V +Ci2C345i3523524e^^^^'+^'"^ 



-C12C34523 - C23C345l2Si3e 
-Cl2C23524S34e'^''' 
-Ci3C245l25i4S34e'^'^ 
+5i2Si3523524534e'^^^^+^^^^ 



-Cl2C23C34S24e'^'^ + C12523S34 
-Cl3C24C345l2Sl4e'^'^ 
+C23Si2Si3S34e'^'^ 
+C345l25l3523524e^^'^^'+^'"^ 



C13C24523 Ci4S24e 

«(5l3+524 — 5i4) 



1624 



-5135145246 

C13C23C34 



-Cl3523524534e 



162 



-C245l35l4534e 



i((5i4 — (5i3) 



-C13C23534 
-Ci3C34523524e 



1824 



-C24C345l35l4e 



ii5i4-5i3) 



C14C24534 



C14C24C34 



(2.7) 



^In the original paper of Fritzsch and Plankl there is a typo in the element Vcb- C23 has to be replaced by 



523- 
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2.2 Experimental bounds 



In this section we summarize the experimental constraints that have to be fulfiUed by the 
quark mixing matrix. The elements of the 3x3 CKM matrix have been studied intensely 
for many years and precision data on most of them is available. In principle there are two 
different ways to determine the matrix elements. On the one hand, they enter charged weak 
decays already at tree-level and a measurement of e.g. the corresponding decay rate provides 
direct information on the CKM elements (see e.g. p4| and references therein). We will refer 
to such constraints as tree-level constraints. On the other hand, processes involving a flavor- 
changing neutral current (FCNC) are forbidden at tree-level and only come into play at loop 
level via the renowned Penguin and Box diagrams. These processes provide strong bounds, 
referred to as FCNC constraints^ on the structure of the CKM matrix and its elements. In 
what follows we discuss the implications of these constraints in more detail. 



Tree-level constraints for the CKM parameters: Since the (absolute) value of only 
one CKM element enters the theoretical predictions for weak tree-level decays, no GIM 
mechanism or unitary condition has to be assumed. By matching theory and experiment the 
matrix element can be extracted independently of the number of generations. Therefore, all 
tree-level constraints have the same impact on the 4x4 matrix as they have on the 3x3 one. 
We take the PDG values for our analysis: 





absolute value 


relative error 


direct measurement from 


Vud 


0.97418 ±0.00027 


0.028% 


nuclear beta decay 


Vus 


0.2255 ±0.0019 


0.84% 


semi-leptonic K-decay 


Vub 


0.00393 ± 0.00036 


9.2% 


semi-leptonic B-decay 


Vcd 


0.230 ±0.011 


4.8% 


semi-leptonic D-decay 


Vcs 


1.04 ±0.06 


5.8% 


(semi-)leptonic D-decay 




0.0412 ±0.0011 


2.7% 


semi-leptonic B-decay 


Vtb 


> 0.74 




(single) top-production 



In the following, we denote the absolute values in the table above as ± AVi. Next, we 
will discuss the bounds coming from FCNCs. 



FCNC constraints: It is well known that FCNC processes give strong constraints on 
extensions of the standard model. In particular information about the CKM elements Vtx 
can be obtained by investigating 5-and X-mixing. The mixing of the neutral mesons is 
described by box diagrams. As an example we show the box diagrams for mixing: 



J t,c,u 



W 



b 



*'"'^b d 



t,c,u 




W 



t,c,u 




Mi2 encodes the virtual part of the box diagrams, which is very sensitive to new physics 
contributions. It is related to the mass difference of the neutral mesons via 



AM = 2|Mi2| 



(2.8) 
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In the SM3 one obtains the foUowing relations 



oc 77ee [xf)' Soix,) + 2vctXf xf S (x,, xt) + vtt [xfySoixt) , (2.9) 



with the Inami-Lim functions [26j 



So{x) 



Ax - llx^ + x^ Sx^ ln[a;] 



S{x,y) = xy 



4(l-a;)2 
1 /I 



+ 



2(1 ' 
3 1 3 



y - a; V4 2 1 - y 4 (1 - y)2 



1 3 1 



ln[y] 



X - y \4: 21- X 4(1- xy 



In [a;] 



3 1 



Al-xl-y 



where 



the CKM elements 



(2.10) 



(2.11) 



(2.12) 



(2.13) 



a5 - VxdV* 



A 



A 



and the QCD corrections 

?]cc = 1-38 ±0.3, = 0.47 ± 0.04, ?7« = 0.5765 ± 0.0065. 



(2.14) 



(2.15) 



The fuU expressions for M12 can be found e.g. in [271 SO]- In deriving these expressions 
unitarity (of the 3x3 matrix) was exphcitly used, i.e. 



A:f + A 



X 



X 



X 







(2.16) 



Moreover, in the 5-system the CKM-elements of the different internal quark contributions 
are all roughly of the same size. Only the top contribution, which has by far the largest value 
of the Inami-Lim functions, survives. This is not the case in the X-system. Here the top 
contribution is CKM suppressed, while the kinematically suppressed charm terms are CKM 
favored. Therefore, both have to be taken into account. More information about the mixing 
of neutral mesons can be found e.g. in [30l [3T] . 

For the mixing of neutral mesons we define the parameter A that quantifies the deviation 
from the standard model [30] : 
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Going over to the SM4, we obtain 

12 



ocr7ec(Af) 5'o(x,) + 277,iAf Af 5(a;„a;0 + %(Af ) S^{xt) (2.18) 
Mf/'^^^ oc r7« (Af^)'5'o(a:t) + r7t,t, (a,^<^)' ^0(^^*0 + 2r7«'Af^A,^<^^(xi, a;*,) , (2.19) 



B.N 2 



(2.20) 



Note that now also those CKM elements change that describe the mixing within the first 
three famihes! For simplicity we take the new QCD corrections to be 



•^t't' = Vtt' = Vtt and 77^' = Vet ■ 



(2.21) 



In addition to the mixing quantities we also investigate the decay h —> s^^. To obtain the SM4 
prediction for b ^ s^y one has to do the whole analysis of this decay without invoking the 
unitarity of the 3x3 CKM matrix, which is beyond the scope of this work. As an estimate of 
the effects of a fourth generation on 6 ^ 57, we simply define the ratio of the CKM structure 
times the corresponding Inami-Lim function i^o(^0 



2 



I A 



SM4\2 nf 



with 



D',{x,f + 2Re (Af^ng^^) D',{xt)D'o{x,) + \Xl^'\'D',{x, 



^, , , -7x + _^ g^3 ^2^2 - 3a;) 

^o(^) = 77^. — + ^^7; — zxr • 



(2.22) 



(2.23) 



12(1 -x)3 2(l-a;)4 

Parameters which give a value of Ah^g-y close to one will also lead only to small deviations 
of T{b s^f^yrib S7)^^3 fj.^^ 

Currently, in particular the hadronic uncertainties are under intense discussion, see e.g. 
[H21- Therefore, we use two sets of bounds for the allowed deviations from the SMS values, 
which cover the possible range of uncertainties, a conservative and an aggressive one: 





Conservative Bound 


Aggressive Bound 




1±0.3 


1±0.1 


<. 


0± 10° 


0±5° 




1±0.3 


1±0.1 




free 


free 




1±0.5 


1±0.25 




0±0.3 


0±0.15 




1±0.15 


1±0.07 



In [33] a very strong bound on IV^^/K^H extracted from L^^-mixing. We redo this analysis 
and confirm the conclusion of [33], although we are able to soften the bound by a factor 



^The Inami-Lim function Dq^Xi) is proportional to the Wilson-coefficient Cj^^Mw)- 
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of v^. The starting point is the mass difference in the neutral L^^-system, which can be 
expressed in terms of the parameter xd- 

HFAG [34] quotes for an experimental value of Xd 

xd = (0.811 ± 0.334) . 10"^ . (2.25) 

Starting with the expression for the box diagram and using the unitarity condition + 
Xf + Af + = (with Xf = we obtain 

oc XlSo{xs) + 2XsXtS{xs, xt) + XlSo{xt) + LD 

+2XsXt'S{xs, X5/) + 2XtXt'S{xt, X5/) + LD 

+XlSo{x,.), (2.26) 
where the proportionality constant is 

GIM^Md 



1271^ 



f^Bnv{m,,Mw). (2.27) 



Lubicz and Tarantino [35] gave a survey of recent lattice data and provided an averaged decay 
constant f^o = 212 ± 14 MeV and bag parameter B = 0.85 ± 0.09. In order to compare with 
the results of [33], we use only the LO expression of the QCD correction factor ry, 




vim,,Mw)^{ " Mmr-^ ^ 0.74. (2.28) 



The first line of ( 12.261) corresponds to the pure SM3 contribution, the third line is due to 
contributions of the heavy 4th generation and the second line is a term arising when SM3- 
and contributions mix: 

<° = <°SM3 + <°M.. + . (2.29) 

The perturbative short-distance contribution to M^2SM'^ numerically very small. The first 
two terms in the first line of (12.261) are kinematically suppressed and the third term suffers 
a Cabibbo suppression caused by a CKM factor of order O (10~^), such that an OPE-based 
standard model calculation yields values of about x A • 10~^. The order of magnitude 
of this result complies with early estimates for x^, which relied merely on perturbation 
theory calculations and ranged between roughly 10~^ [36j and 10~^ [37j. It has often been 
pointed out that in the case of charmed mesons a substantial enhancement of the mass and 
width differences has possibly to be attributed to long-distance (LD) effects, which cannot 
be calculated perturbatively, see e.g. [38l |39l SHI [HI [42]. The quoted predictions usually 
rely on exclusive estimates of decay widths; they can be considerably increased by nearby 
resonances. Typical results are in the range oixo^HD — 10~^ . . . 10~^, which almost reach the 
order of magnitude of the experimental values. Bigi and Uraltsev [38] argue that, albeit the 
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leading l/rUc contributions are negligibly small and the validity of duality is very questionable, 
operators of higher dimension might lead to values oi Xd^Vd ^ ' 10~^ in the framework 

of the standard OPE techniques, what is already very close to the experimental values. 
The short-distance terms of the mixed part M^^mix numerically at most as large as the 
short-distance part of the pure SM3 contribution. The 5-quark term of the mixed part is 
about twice the 6-quark term and it might also be affected by large long-distance effects. 
For M^2,h' the OPE is expected to work perfectly and no sizeable unknown non-perturbative 
effects are likely to appear. Numerically this term can be much larger than the short-distance 
parts of the SM3- and the mixed contribution. 

The idea of [33] was to neglect all terms in M^^ 5 except M^^^,, and to equate this term 
with the experimental number for xd- Following this strategy we reproduce the bounds 
given in [33j. We think, however, that it is not completely excluded that there might be 
large non-perturbative contributions to both M^2,sm'^ M(^ j^-^^ each of the size of the 
experimental value of Xd- This would enhance the possible range for M/^^^, by a factor of up 
to 3 compared to [33]. Allowing this possibility we obtain the following, very conservative 
bounds on iKt^^K^H^ ^^^^ Fig.([l]): 

( 0.00395 for m^/ = 200 GeV, 
\Vub'Vcb'\ < I 0.00290 for m^/ = 300 GeV, (2.30) 
[ 0.00193 for m^/ = 500 GeV. 

Even as we were able to soften the bound of |33J by a factor ^/3, L)°-mixing is still by far the 
strongest direct constraint on iKi^^K^H- We take the values of Eq. (12.301) for our conservative 
bounds, while we take the results of [33j as the aggressive ones. 

2.3 Scan through the mixing parameters 

Subsequently, we will describe the scan through the nine-dimensional parameter space of 
the 4x4 mixing matrix and the mass regions for m^/ and test whether the experimental 
constraints on quark mixing are fulfilled. For this purpose we use the exact parameterization 
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Figure 2: In the upper left and upper right panel, the allowed parameter ranges for 9u on 
the X axis and 6^24 on the y axis are shown for the conservative and the aggressive bounds, 
respectively. The colour encodes the relative occurrence as explained in the text. In the lower 
left and right panels the allowed parameter range is shown in dependence on the f mass for 
three different mass ranges for the conservative and aggressive bounds, respectively. 



of VcKMA described in Section 2.1, Eq. ( 12.71 ). For the allowed ranges - especially on the 
new parameters related to the fourth generation - it is crucial how to treat the errors of the 
tree level bounds. We have decided to study two different treatments of the error ranges. 
We adopt a conservative and an aggressive set of bounds. In both the conservative and the 
aggressive case, the bound on Vtb is assumed to be hard. We enforce each of the six other 
tree-level constraints to be individually fulfilled at the 2a level, i.e. our CKM matrix element 
VcKM4,i has to be in the range 

\V,\ - 2AV, < |ycKM4,z| < \V^\ + 2AV,. 

Additionally, in order to have a measure for the deviation from the central values of the tree 
level bounds, we define a P^i" degree of freedom (d.o.f.) as 



2/1 r 1 /|VcKM4,i| - 

^ Z^"-^- = n 2: [ j 

i=ud,us,ub,cd,cd,cb ^ 



2 



where n = 6 is the number of considered degrees of freedom. For the conservative constraints 
we call for /d.o.f. < 2 and for the aggressive ones for /d.o.f. < 0.5. The choice for the 
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Figure 3: The allowed parameter ranges in 624 and ^34. For further explanation, see the 
caption of figure [2l 



aggressive bounds has been inspired by the fact, that one obtains for the best CKM3 fit given 
by the PDG x^/d.o.f. = 0.4. In other words, with our aggressive constraints on the tree level 
bounds, we do not want to violate the tree level constraints significantly more than the CKM3 
fit. From the tree level constraints and careful checks with larger parameter ranges, we find 
that we safely restrict ourselves to the ranges given in Table [H The phases Sis^Su and 624 
have been left unconstrained. The mass m^/ was scanned from 300 to 650 GeV as described 
in Equation ( 12.41) . In this ten-dimensional space we generate more than 2 • 10^^ randomly 
distributed points and check whether they meet the tree level and FCNC constraints given 
aboveEl To this end, we first employ the conservative set of bounds. We only store parameter 
sets which satisfy these bounds - only 12 817 846 data sets remain afterwards. The aggressive 
bounds are established by subsequent reduction of the conservative data, leaving only 150 
763 points. To give an impression, how important each constraint is under the assumption 
of our preselection, we have used each bound individually and switched oS the others. 

We obtain the following result: Already the tree-level constraints reduce the allowed 
parameter space dramatically. Only 13% of the randomly created points in the preselected 
parameter space actually pass the combined tree-level bounds. The strongest restrictions 
stem from \Vud\^ which is constrained to a relative error of only 0.028 %. As a consequence, 
due to Vud = C12C13C14, the allowed ranges for 612 and 9u are quite small (^13 is tiny, its 
precise value does not play a major role for Another important contribution to the 

similar strategy with 60 000 points was pursued in [43j. 
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Figure 4: The allowed parameter ranges in 5is and 5u. For further explanation, see the 
caption of figure [2l 





612 


ei3 


623 


ei4 


624 


634 


min. value 


0.222 


0.0033 


0.038 











max. value 


0.232 


0.0048 


0.046 


0.069 


0.19 


0.8 



Table 1: Preselection bounds resulting from tree level determinations of the CKM elements 
for the angles of the quark mixing matrix. 



rejection rate stems from the bound. The FCNC constraints are even more restrictive, 
e.g. even in the conservative case only 1.5% of the configurations pass the A^^ bound, see 
Table [2] for more details. Having done our scan, we have found no accepted parameter sets 













mixing 


w/o tree- level bounds 


21% 


1.5% 


29% 


16% 


46% 


w tree-level bounds 


27% 


2.1% 


32% 


20% 


62% 



Table 2: The impact of the (conservative) constraints on the five fiavor changing neutral 
currents. The second line gives the probability that a random point in the configuration 
space fulfills the FCNC bounds. The third line corresponds to the probability that a set of 
angles and phases that is in agreement with tree-level bounds also passes the FCNC bound. 
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Figure 5: The allowed parameter ranges in 5u and 624- For further explanation, see the 
caption of figure [21 Here, the mass dependence is not explicitly shown, as all combinations 
are allowed for each mass m^/. 





0.224 0.226 0.228 



0.23 



0.225 0.226 0.227 0.228 0.229 



Figure 6: The allowed parameter ranges in Ou and 9u. For further explanation, see the 
caption of figure [2l Here, the mass dependence is not explicitly shown, as all combinations 
are allowed for each mass m^/. 



beyond the following ranges: 





Conservative Bound 


Aggressive Bound 


9u 


< 0.0535 


< 0.0364 




< 0.144 


< 0.104 


034 


< 0.737 


< 0.736 


du 


free 


free 


^24 


free 


free 



This is one of the main results of this work. Typically small mixing with the fourth family 
is favoured, but there is still room for sizeable effects. To further explain our results, we 
note that not all combinations for these new parameters are allowed. Apart from studying 
the allowed parameter regions in a one dimensional projection as presented above, we show 
correlations of selected input parameter pairs. Figures El El [H [5] and [6] correspond to the 
^14 — ^24, ^24 — ^34, ^^13 — ^^14, ^^14 — ^^24 and ^12 — ^14 planes. We divide each direction (i.e. x-axis 
and y-axis) of each plot in 300 steps. So that the total picture consists of 300 x 300 = 90000 
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Figure 7: The results for A^o shown in the complex plane (real part on the x axis and 
imaginary part on the y axis): in the left panel for the conservative bounds and in the right 
panel for the aggressive ones. 
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Figure 8: The results for A^^ as described in the caption of figure [71 



colour encoded unit squares. In the upper panels the colour encoding counts the number 
of accepted sets in each unit square. As a large range is covered, we chose to plot Figures 
O [31 m and [6] logarithmically. The number next to the colour scale then gives the natural 
logarithm of the number of accepted sets per unit square. As the distribution in the 6u — ^24 
plane is somewhat more homogeneous we choose a linear scale for Fig. [5l The upper left 
panel in each plot is for the conservative bounds and the upper right one for the aggressive 
ones. In the lower panels we present the mass dependence of the allowed parameter ranges. 
Obviously, there is a non-trivial infiuence of the f mass on these ranges. The left panel 
corresponds to the conservative and the right panel to the aggressive bounds. The plots 
show the distribution of the accepted points in the three mass regions indicated in the plot. 
In most cases a lower mass results in a larger allowed parameter space. But there are also 
non-trivial exceptions, cf. Figure [3l Especially the restriction due to the mixing bound 
(as described in Section 2.2) can be seen clearly as hyperbolic cuts in Figure [3 The mass 
dependence in Figure [5] is not shown as in each case the whole square is filled. 
In Figures [71 [8] and [9l the distribution of the accepted points in the complex A[xo^Bd,Bs] plane 
is shown. As above, in each plot the left panel corresponds to the conservative constraints and 
the right panel to the aggressive ones. For A^o and A^^ a logarithmic scale is chosen and for 
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Figure 9: The results for A^^ as described in the caption of figure [71 The red hne represents 
a $s angle of —45° which is hinted by recent experiments. 
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Figure 10: The mf dependence of the FCNC As: from left to right A^, A^^ and A^^. 



A^^ a linear one, corresponding to the observation that for the points are somewhat more 
homogeneously distributed as in the other two cases. This corresponds to the observation 
that the acceptance rate of the bound is very low, only 2.1 % after tree level bounds, as 
shown in Table [2l The reason for this behaviour is the following: Enforcing only the tree-level 
bounds and unitarity A^^ can take values up to 50 times the Standard Model prediction. 
Therefore, the stringent experimental bounds on A^^ put forward severe restrictions on the 
allowed parameter range. 

In Fig. [To] the dependence on the t' mass for the three FCNC observables is shown. 
Only for A^^, a strong infiuence of the mass on the results is seen. For A^o the infiuence 
is still perceivable but rather weak, whereas A^^ seems to be almost independent of m^/. 
The complex A^ planes are particularly interesting since there might be some hints on new 
physics eflFects in Bs mixing, see [30l Hlj and the web-updates of [45j. In [30j a visualization 
of the combination of the mixing quantities AM^, AF^, a^^, which are known to NLO-QCD 
[271 [36l WJ[ [38] and of direct determinations of $s in the complex A-plane was suggested. 
Combining recent measurements [l9l [50] for the phase $s one obtains a deviation from the 
tiny SM-prediction ^] in the range of 2 to 3 a: 



• HFAG: 2.2 a [49j, 

• CKM-Fitter: 2.1. ..2.5 a [5ll[52|, 

• UT-Fit: 2.9 a [Bj. 
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Figure 11: The results for Vtb as described in the caption of figure [71 The red crosshnes give 
the value for CKM3. 
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Figure 12: The results for Vts as described in the caption of figure [71 The red crosslines give 
the value for CKM3. 



The central values of these deviations cluster around 

^ -45°. (2.31) 

As can be read oS from Figure [9] sizeable values for $5 can also be obtained in scenarios 
with additional fermions. Such large values for $5 are not favoured, but they are possible. 
An enhancement of $5 to large negative values by contributions of a fourth family was first 
discussed in p^ . 

In Figures [TH [12] and [13] we present the values for the CKM matrix elements Vtb^ Vts and 
Vtd in the complex plane. As in the Figures [71 [8] and [9] the left panel is for the conservative 
case and the right panel for the aggressive one. For comparison the SM3 expectations are 
given as thin red lines. Obviously, large deviations from the SM expectations are possible. 
The peculiar structure of the allowed range for Vtd arises already after imposing unitarity 
and tree-level constraints. The non-trivial mass dependence for the aggressive case is shown 
in Fig. [HI In Figure [15] we show the mass dependence of the acceptance rate. The number 
of accepted data points per 50 GeV normalised to the total number of accepted points is 
plotted versus the mass m^/. It can be seen that the acceptance rate reduces with growing 
f mass. Because our test points are randomly distributed over the whole mass region, an 
acceptance rate independent from the mass would feature a constant functional behaviour; 
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Figure 13: The results for Vtd as described in the caption of figure [71 The red crosshnes give 
the value for CKM3. The peculiar ring structure already arises after enforcing unitarity and 
tree-level bounds. 
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Figure 14: The dependence of the CKM elements Vtb (left panel), Vts (middle panel) and Vtd 
(right panel) on the mass region. 



this is clearly not observed. One can also notice a small diflFerence in the acceptance rate for 
conservative and aggressive bounds. 



3 Taylor expansion of Vckma 

The hierarchy of the mixing between the three quark families can be visualized by the Wolfen- 
stein parameterization [53j . It is obtained from the standard parameterization by performing 
a Taylor expansion in the small CKM element Vus ^ 0.2255. Following [54] we define 

Vub = sise-^'^" =:AX\p + tfi) (3.1) 

= si2(l + 0(A'))=:A (3.2) 

V,b = S23{l + 0{\'))=:A\^ (3.3) 

Note, that due to historical reasons the element Vub is typically defined to be of order A"^, 
while it turned out that it is numerically of order A**. 

iKfcl = 0.00393 = 1.51A^ = 0.34A2 (3.4) 
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Figure 15: Relative distribution of the accepted 12 817846 and 150 763 points using the 
conservative and the aggressive bounds, respectively. The relative occurrence is shown on 
the y axis and m^/ on the x axis. 



Up to terms of order the Taylor expansion of the CKM matrix assumes the form: 



VcKMS 



1 



_ Al _ A_ _ Al 

2 8 16 



8 



A: 



A\'^{p-if})\ 
A\^ 



-A\\l-\^\^{~p^tfj)-\) 1 



(3.5) 



This result can be obtained from the standard Wolfenstein parameterization by replacing 

p=:Ap, r]=:Xfj. (3.6) 

For the case of 4 generations we have to determine first the possible size, i.e. the power in A 
of the new CKM-matrix elements. With the results of the previous section we obtain: 





Conservative Bound 


Aggressive Bound 


Kb' 




< 0.0535 ^ 1.05A2 


< 0.0364 ^ 0.7A2 3.2A3 


IK*' 




< 0.144 ^ O.GA^ ^ 2.8A2 


< 0.104 ?«0.46Ai ^2X^ 


\Vtb'\ 




< 0.672 ^ 3.0A^ 


< 0.671 ^ 3.0A^ 



We propose a parameterization of these matrix elements that manifestly respects the above 
bounds: 
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• For the mixing of first and fourth family we define 

Vw = sue-'^'* =: X^{xu - iyu) 



^ CM = 1 - A^^ii±^ + O (A«) , (3.7) 

which is a good estimate for both, conservative and aggressive bounds, since the pa- 
rameters Xi4 and yi4 can safely be assumed to be smaller than 1. 

• The estimate for the matrix element Vcb' is more complicated. The conservative bound 
suggests a size of order A, whereas the aggressive bound might justify a leading power 
A^. In what follows we opt for the more solid 0{X) variant. We define: 

Vcb' = cuS24e~'^^^ =: (0:24 - i|/24)A^ 

^ S24e-'^'' = {X24 - iy2i) A + ^ (x?4 + yl4) (X24 - iy2A) A^ + O (A^) 

^ C24 = 1 + ^ (-^24 - 1/I4) A^ - ^ (a:24 + yl4) ^A^ 

+ (-^24 - 1/24) ' + 3 {-xl4 - yl^) {xl + yl,)^ + O {X') 

(3.8) 



• Finally, the element \Vtb'\ is not constrained to be significantly smaller than one and 
we cannot restrict the mixing angle B34. Thus, we keep cosine C34 and sine 534 in the 
expansion. 

It is obvious that already at 0{X^) the expansion gets confusing, see (13.81) . For the Taylor 
expansion to provide an intuitive picture of the hierarchy of the elements and the still possible 
effects of the mixing with the fourth generation we want to keep the matrix clearly arranged. 
Therefore we expand the CKM4 matrix up to and including order A^. The matrix elements 
take the form 

Vud = l-^-l (4a:?4 + 4yl + l) A^ = A 

Z o 

Vub = A{p - if])X^ Vub' = (xu - iyu) X^ 



(3.9) 
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= - A + ^ (x24 - iy2A) (-2a;i4 + X2i - 2iyi4 + iy2i) 

Vcs =1 - ^ (3^24 + Vl^ + 1) A' 

-4A^ + 2yl^ - 8x14 (a;24 - iy2^ - Syuy24 - l) A^ 

Vcb' = {X24 - iy24) >^ (3.10) 
Vtd =S34 {-Xu + X24-i {yi4 " ?/24)) A^ 

+ AC34A2 + ^ [A(-2i77 - 2p)c34 + S34 {xi4 + iyu) (a;24 + I/24 + l)] A^ 

V'is =-S34 ix24 + «?/24) A - Ac34A^ 

+ ^^34 (-2X14 + 2^24 - 2«?/i4 + «?/24) A^ " ^ [AC34 (^24 + 1/24 " l)] A"^ 

=C34 - yls34 (X24 + il/24) A^ " ^ (^^£34) A"^ 
=S34 - ^ [S34 (2:24 + ^24)] A^ 

- I [s34 {xt^ + ^yl^xl^ + yl^ + Axl^ + 4?/2^) ] (3.11) 
Vfd =C34 [-a;i4 + a;24 - i (?/l4 - y24)] A^ 

- As34A^ + ^ [2yl(i?7 + p)s34 + C34 {xu + ^I/m) (2^24 + I/I4 + l)] A'' 

VJ's = - C34 (X24 + %24) A + AS34A^ 

+ ^C34 (-2X14 + 2^24 " 2i?/i4 + iy24) A^ + ^^^34 (^^L + 1/24 " l) A"^ 
Vt'b = - S34 - ^C34 (X24 + iy24) >? + ^^^S34A'^ 
=C34 - ^ [C34 (^24 + yl^] A^ 

- ^ h4 (x^4 + 2^/2'42;24 + yt4 + 4x^4 + 4y24)] A^ (3.12) 
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The red colored terms indicate possible new leading order effects in the standard CKM3 
matrix elements due to mixing with the fourth family. 



4 Unexpected parameter regions 

In the experimentally allowed regions of the parameter space we typically find regions, where 
the mixing with the fourth family is very small and the CKM elements of the first three 
families are close to the minimal standard model values. There are also some allowed regions 
with large deviations from the standard expectations. In order to clarify the appearing 
cancellations, that veil these unexpected eflFects in current analyses of the standard CKM 
matrix, we discuss three sample sets of values for Vckma- Our three parameter sets read: 





Set I 


Set II 


Set III 


^12 


0.226606 


0.227264 


0.228225 


023 


0.040389 


0.0414083 


0.039522 


013 


0.0040559 


0.00382191 


0.00382755 


014 


0.0277527 


0.0182248 


0.0232895 


024 


0.0176553 


0.0789555 


0.110918 


034 


-0.531735 


0.366353 


0.677976 


Sl3 


3.31463 


0.317332 


1.25537 


5i4 


0.925439 


0.28357 


0.502528 


^24 


2.69829 


0.383156 


0.238529 




325.553 GeV 


653.842 GeV 


389.238 GeV 



First we have a look at the CKM elements Vtx obtained with these three parameter sets. We 
give their complex values, as well as the ratio of their absolute value compared to the SM3 
values from [25j: 





Set I 


Set II 


Set III 


Vtd 


0.0212 + 0.0107i 


0.0052 - 0.0005? 


0.0089 - 0.0059i 


\vta\/mn 


2.72 


0.60 


1.22 


Vts 


-0.0391 + 0.0064i 


-0.0653 - 0.0109i 


-0.0987 - 0.0182i 


\vts\/\Vtr'\ 


0.97 


1.63 


2.47 




0.8609 + O.OOOli 


0.9317 - 0.0004? 


0.7755 - 0.0006i 


Vt,\/\vr' 


0.86 


0.93 


0.78 



These results significantly differ from the values obtained from SMS CKM fits. In order to 
clarify the question why these huge effect cannot be seen in the standard CKM-fits [451 [44] 
we have a closer look at e.g. A^^. This quantity was defined as 



M 



12,SM4 



i\yrtt,Bd 



(4.1) 



The tt part of the SM4 value MI^^'^ma looks formally equal to M^^sm3-> the values of the 
CKM elements Vtx can be very different for SM3 and SM4. We further rewrite A^^ as 

rtt' -\-t' t' ,B d 



^ _^ ^^-^12,SM4 ^^-^12,SM3 _^ ^^-^12,SM4 



^U,SM3 



^U,SM3 



(4.2) 
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The first correction term to "1" is due to the difference of the CKM elements Vtx in the three 
and four generation standard model, while the second correction is due to new virtual loop 
effects of the t' quark. The three parameter sets, discussed in this section, were chosen in 
such a way that large cancellations appear mimicking the SMS perfectly. Therefore, these 
big effects are invisible in CKM fits. 

With our special parameter sets we numerically obtain the following values for the three 
contributions to A: 

Set I: 

Ai^o = 1 + (0.0139 - 0.0854i) + (-0.0362 + 0.04160 

= 0.98-e-'2.5°^ (43) 

As, = 1 + (-1.6939 - 5.4548i) + (1.7352 + 5.3184i) 

= 1.05-e-^^-^°, (4.4) 

Ab, = 1 + (-0.3415 + 0.2492i) + (0.3608 - 0.3662?) 

= 1.03-e-*-5°, (4.5) 

Afe^,^ = 1 - 0.2959 + 0.3715 = 1.0756 , (4.6) 

$f = -0.114276 = -6.5° . (4.7) 

Huge cancellations appear, in the case of the imaginary part of Bg mixing up to 500%. Taking 
experimental and theoretical uncertainties into account, the final results are still perfectly 
consistent with the SM3 expectation. 
For the next parameter set we get: 

Set II: 

A;^o = 1 + (-0.0016 - 0.0017i) + (-0.0246 - 0.0071i) 

= 0.97-e-*°-^°, (4.8) 

As, = 1 + (-0.7383 - 0.1732i) + (0.4631 + 0.0826i) 

= 0.73-e-^^-^°, (4.9) 

Ab, = 1 + (1.2044 - 0.6715?) + (-1.3434 - 0.0354?) 

= 1.11-6-^39°, (4_;Lq) 

Af,^,^ = 1 + 1.3044 - 1.3879 = 0.9165 , (4.11) 

$f = -0.687 = -39° . (4.12) 

This set was chosen by looking for large values of $«. As discussed in Section 2.3 there are 
currently some experimental hints for such a deviation from the standard model. Here we 
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confirm the statement from [12] that such a value could be explained by a forth generation 
of quarks. 

As a final example we present a parameter set yielding a value for \Vtb\ as small as 0.78. 

Set III: 

A^o = 1 + (0.0108 + 0.0919i) + (-0.0388 - O.OlOGi) 

= 0.98.6+^^-^°, (4.13) 

= 1 + (-0.1691 + 0.3448z) + (0.1681 - 0.4824i) 

= 1.01.e-^'-^°, (4.14) 

Ab, = 1 + (2.4697 - 1.1837i) + (-2.8227 + 0.8334z) 

= 0.74-6-^28°^ (4^^5^ 

^b^sj = 1 + 2.6661 - 2.7172 = 0.9489 , (4.16) 
$f = -0.4961 = -28°. (4.17) 

A small value of Vtb would also lead to a smaller rate for e.g. the single top production at 
TeVatron. See e.g. [55j for a recent measurement of this rate. 

Note that the eflFects described in the chosen sets are very sensitive to small variations in 
the mixing angles and phases of the fourth family. This is obvious as the large cancellations 
described above require very specific parameter sets. The dependence on the f mass, in 
contrast, is moderate. 

5 Conclusion 

We have investigated the experimentally allowed parameter range for a 4x4 quark mixing 
matrix, making some simplifying assumptions concerning the QCD corrections. Moreover we 
have not taken into account any correlations with the lepton mixing matrix. 
As a result we find that the tree-level constraints for the 3x3 CKM-matrix and the FCNC 
bounds from K-^ D^- B^- and Sg-mixing as well as the decay b ^ sj are typically fulfilled if 
we have a small mixing with the fourth family, which allows us to perform a Taylor expansion 
of the 4x4 CKM matrix. Unexpectedly we were also able to find experimentally allowed pa- 
rameter sets, having a sizeable mixing with the fourth generation. In this case also the usual 
3x3 CKM matrix elements can change considerably: Vtd and Vts can differ by up to a factor 
3 compared to the SM3 value and Vtb can be as low as 0.75, see also [56] for the possibility of 
Vtb being unequal to one. These dramatic effects are not seen in the CKM fits. This is due 
to large cancellations between the effect of changed matrix elements Vtx and effects of virtual 
heavy and f quarks. An example of such a cancellation was also discussed in ^57j. We have 
also shown that there are parameter ranges consistent with all experimental bounds, which 
yield large effects for $s. 

Due to these interesting results, it seems worthwhile to extend the current exploratory anal- 
ysis. First more flavor observables, like asymmetries, b sl^l~ (see e.g. [58l[59j), Bg /x/x. 



21 



... should be considered. Moreover, the electro- weak precision observables have to be in- 
cluded in more detail, here in particular the observable seems to be promising, see e.g 
[60] . Another important improvement will be the exact treatment of the perturbative QCD 
corrections, in particular in the decay b 57. Finally one has also to take into account 
correlations to the lepton mixing matrix. 

Refined direct measurements of the CKM matrix elements will provide more insight into 
a possible fourth generation. In particular, future experiments could help to determine the 
hardly known CKM elements Vcd and Vcs as well as non-perturbative parameters like form 
factors and decay constants. Probably the most stringent bounds on the mixing with the 
fourth generation can be obtained from the direct measurements of V^^, Vts and Vtb- Vth is 
currently investigated at TeVatron; for the latest value of Vth from single top production see 
[551EIIE2]. 

Also more precise data on FCNC will be very helpful. For the case of the promising Bs system 
this is currently done at the TeVatron and in the near future at LHCb [63] and probably at 
Super B factories [64l [65] . 
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